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The  concept  of  adaptive  power  separation  for  single  channel 
applications  based  on  the  ‘leaRy*  LMS  algorithm  has  now  been  extended 
for  adaptive  array  applications.  A new  algorithm  designated  as 
•scheme  6A*  has  been  shown  to  be  potentially  highly  effective  for 
nulling  strong  jamming  signals  in  an  aircraft  receiving  environment. 

The  new  scheme  is  substantially  less  noisy  and  more  simple  to  implement 
than  "scheme  6"  which  was  analysed  during  our  previous  year's  effort. 

Using  scheme  6A,  one  could  establish  an  omnidirectional  quiescent 
receiving  pattern  in  order  to  accept  incoming  signals  regardless 


I 


of  their  angles  of  incidence.  This  pattern  is  sustained  as  long  as 


ii: 
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all  incoming  signals  are  "weak".  However,  in  the  presence  of  "strong" 
incoming  signals  (jammers),  regardless  of  their  angles  of  incidence, 
the  quiescent  receiving  pattern  changes  as  deep  nulls  form  in  the 
directions  of  the  strong  signals  (jammers)  as  a result  of  the  adaptive 
process. 

The  adaptive  algorithm  sustains  the  quiescent  pattern  with  a 
"soft"  constraint.  A conflict  develops  with  the  incidence  of  a strong 
input,  which,  if  strong  enough,  causes  the  soft  constraint  to  be 
violated  and  a null  to  form.  The  separation  between  a strong  (jammer) 


input  to  be  rejected  and  a weak  (signal)  input  to  be  accepted  is 
determined  by  a parameter  y in  the  algorithm  which,  in  an  operational 
system,  could  be  controlled  by  a panel  knob.  The  power  gain  of  the 
receiving  array  in  the  jammer  direction  is  reduced  by  the  factor: 


where  o*  is  the  jammer  power  and  N is  the  number  of  weights  in  the 
entire  antenna  array  processor. 


PART  2 

All  real-time  adaptive  processes  experience  noise  in  the  adaptive 
parameters.  The  amount  of  noise  depends  on  the  nature  of  the  adaptive 
algorithm,  on  the  number  of  parameters,  and  on  the  speed  of  convergence. 
A fundamental  study  of  parameter  noise  and  its  effects  on  the  output 
signal  has  been  undertaken  for  stochastic  and  deterministic  inputs  to 
weight-controlled  adaptive  filters  driven  by  the  leaky  LMS  algorithm. 
Weight  noise  has  been  determined  for  the  case  of  an  input  consisting 
of  a sinusoidal  signal  plus  white  noise,  for  wide  ranges  of  SNR  and 
frequency  relative  to  Nyquist.  Broad  operating  regions  have  been  found 


r- J;-. 


where  the  output  power  due  to  weight  noise  is  less  than  5%  of  the 


output  signal  power,  -- 

I 

Weight  noise  also  has  a significant  effect  on  stability  of  the 
adaptive  process.  An  exact  analysis  was  performed  of  a special  single- 
weight  case.  It  was  found  that  leaky  LMS  (and  LMS)  filters  may  hot 
stabilize  in  the  mean-square  sense  even  though  they  converge  in  the 
mean.  It  is  known  from  previous  work  that  convergence  in  the  mean 
is  insured  by: 

! > f.  y ;>  Q 

(total  input  power) 

i 

A new  criterion  for  y has  been  found  which  guarantees  mean-square 
stability: 

(total  input  power)  6 (total  input  power) 
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PART  1 

ADAPTIVE  ARRAY  PROCESSING  FOR  SEPARATION  OF  INPUTS  BY  POWER  LEVEL, 

' I 

FREQUENCY.  AND  ANGLE  OF  INCIDENCE  j 

-j 

] 

1 

I 

1-A.  Introduction  j 

Our  research  on  adaptive  techniques  for  antijam  systems  has  con-  | 
centrated  on  the  application  of  a modified  form  of  the  LMS  algorithm  ^ 
to  antenna  arrays,  permitting  discrimination  against  received  signals 
on  the  basis  of  their  power  levels,  using  spatial  and  frequency  ^ 

filtering.  This  type  of  antijam  system  is  applicable  to  situations 
where  the  desired  signals  are  much  weaker  than  jamming  signals. 
Knowledge  of  direction  of  arrival  and  of  other  specific  characteris- 
tics of  the  desired  signal  is  not  required  beforehand  since  the  adap- 
tation process  uses  only  signal  power  as  the  basis  for  discrimination. 

! 

l-B.  Review  of  Scheme  q | 

The  goal  of  this  activity  has  been  the  development  of  an  adaptiv4 
antenna  array  whose  sensitivity  is  high  and  essentially  omnidirection- 
al  to  weak  inputs,  and  whose  sensitivity  is  low  to  strong  signals  re- 
gardless of  their  angles  of  incidence.  The  objective  has  been  to 
cause  high  power  jamming  signals  to  be  severely  attenuated  while  lowel 
power  communication  signals  are  only  slightly  attenuated.  We  thereby 
realize  a substantial  signal-to- jammer  improvement. 

Figure  1 demonstrates  the  type  of  antenna  reception  patterns  that 
are  dc-sired  (anJ  which  have  been  achieveu  with  the  current  algorithm)  4 
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FIG.  I.  DIRECTIVITY  PATTERNS 
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The  patterns  shown  are  directivity  patterns,  where  the  antenna  array 
itself  is  located  at  the  origin  of  the  pattern,  and  where  the  signal 
or  jammer  is  arriving  directly  from  the  right  (along  the  axis  shown). 
Figure  la  shows  directivity  patterns  corresponding  to  a set  of  weak 
incoming  signals.  It  is  evident  that  the  patterns  remain  essentially 
omnidirectional  for  all  of  the  signal  powers  listed.  Figure  lb  shows 
directivity  patterns  for  a set  of  strong  jammers.  It  can  be  seen  that 
as  the  jammer  power  grows,  the  array  places  deeper  and  deeper  nulls  ii 
the  direction  of  the  jammer. 

An  adaptive  system  which  behaves  in  the  manner  just  described  is 
diagrammed  in  Figure  2.  The  behavior  of  this  system  was  examined  and 
reported  in  [1]  and  has  been  called  "Scheme  6”.  Ke  summarize  its 
behavior  here.  A six  element  circular  antenna  array  (as  an  example)  i| 
processed  by  six  slave  filters  (TF^)  to  produce  the  array's  output. 

The  weights  of  the  slave  filters  are  taken  from  a corresponding  set 
adaptive  or  "training"  filters.  The  input  to  each  independent  train- j 
ing  filter  (TF^)  is  the  associated  antenna  element's  signal  plus  a | 
white  noise  "pilot  signal".  The  impulse  responses  are  adjusted  by  th^ 
LMS  algorithm  so  as  to  best  minimize  (in  the  least  squares  sense)  the  | 
difference  between  the  summed  outputs  of  the  six  training  filters  and 
the  sum  of  the  pilot  signals. 

This  results  in  the  following  behavior:  in  the  absence  of  incomH 
ing  signals  or  jammers,  the  pilot  signals  force  the  impulse  responses  : 
of  all  of  the  adaptive  filters  to  become  zero-delay  unit  impulse 
responses.  In  this  situation,  the  antenna's  pattern  is  essentially 
omnidirectional  (due  to  symmetry).  Now  when  an  external  signal  is  re- 


ceived,  the  LMS  algorithm  attempts  to  reject  it  by  creating  a null  in 
the  sensitivity  pattern  in  the  signal's  direction  at  the  signal's  fre 
quency,  because  this  incoming  signal  is  uncorrelated  with  the  pilot 


signal.  However,  the  pilot  signals  and  the  adaptive  process  have 


created  a "soft  constraint"  that  attempts  to  maintain  uniform  recep- 
tion in  every  direction.  The  array  pattern  cannot  be  omni  and  null  1 


simultaneously.  Therefore  the  LMS  algorithm  computes  a pattern  that 


a compromise  of  the  two.  The  compromise  solution  achieved  is  a func- 


tion of  the  power  of  the  pilot  signals  relative  to  the  power  of  the 


received  signal.  As  we  can  see  from  Figure  1,  a strong  received  sig- I 


nal  causes  a deeper  notch  than  a weak  one,  accomplishing  the  stated 


beamforming  goal.  This  inruitive  argument  has  been  confirmed  analyti 


cally. 


The  patterns  shown  in  Figure  1 are  the  receiving  patterns  of  the 


antenna  array  at  the  convergence  point  of  the  algorithm.  In  reality. 


the  algorithm  never  stops  exactly  at  the  convergence  point,  but  moves 


around  it  slightly  in  a random  fashion  due  to  weight  vector  noise 


12),13],[4J. 


Figure  3 shows  the  effects  of  weight  vector  noise.  We  assume 


that  a single  sinusoid  is  being  received  by  the  computer-simulated  ac^ 


ray.  Figure  3a  is  the  time  waveform  output  (the  "RF  waveform")  of  tM 


array  system  for  a strong  input,  i.e.  a jammer.  Figure  3b  is  the  timl 


waveform  output  of  the  array  system  for  a weak  input.  In  each  case 


the  figure  shows  several  cycles  of  the  sinusoids  before  adaptation  isj 


allowed  to  begin.  Without  adaptation,  there  is  no  rejection.  Refer-I 


ring  to  Figure  3a,  we  note  that  for  the  strong  jammer,  attenuation  is] 


Figure  3;  Output  Waveforms  of  the  Scheme  6 Adaptive  Oeamfomier 
with  6 Element  Circular  Array 
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rapid,  but  noisy.  A portion  of  the  time  waveform  is  plotted  on  a mag-  ! 
nified  scale.  After  convergence,  noise  in  the  weight  vector  randomly  | 
modulates  the  strong  sinusoidal  input,  producing  a substantial  amount  | 
of  output  noise.  The  jammer  is  thus  not  completely  rejected.  Its  ef-  ! 

f 

fects  are  manifested  in  the  residual  output  noise.  Referring  to  Fig-  | 

I 

ure  3b,  we  note  that  the  low  power  sinusoidal  input  is  attenuated  more  \ 
slowly  and  to  a much  lesser  extent,  but  that  its  essential  charac-  | 

i 

i 

teristics  remain.  However,  a close  examination  of  this  time  waveform  i 

i 

\ 

shows  that  its  amplitude  is  varying  somewhat  over  time.  The  array  pro- i 
cessing  algorithm  has  added  some  random  modulation  to  the  signal.  Be-  | 
cause  of  the  noise  in  the  weights,  the  amount  of  output  power  result-  | 
ing  (after  convergence)  from  the  incoming  strong  signal  exceeds  the  | 
output  signal  power  resulting  from  the  weak  incoming  signal.  This  is  ; 

I 

not  a satisfactory  situation,  even  though  the  jammer  has  been  substan- I 
tially  attenuated.  I 
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of  transversal  filters  in  order  to  produce  the  system  output  (Scheme  6 


required  two  sets  of  filters) . In  Scheme  6 the  required  performance 
was  accomplished  by  introducing  a unique  training  signal.  In  this  new 
scheme,  the  effect  of  the  training  signal  is  accomplished  directly  by 
the  adaptation  algorithm.  As  a result,  no  training  signal  is  required, 
significantly  reducing  system  hardware  requirements. 

The  adaptation  algorithm  of  Scheme  6A  is  presented  in  Figure  4. 

By  examining  this  algorithm,  its  relationship  to  the  standard  LMS  al- 
gorithm is  clear.  However,  the  Scheme  6A  algorithm  includes  one  more 
"driving"  term  which  is  necessary  to  produce  the  required  behavior. 

To  use  this  algorithm,  one  must  know  what  the  desired  weight  vector 
would  be  in  the  absence  of  any  signals.  We  call  this  desired  weight 
vector  the  "quiescent  weight  vector"  If  for  each  adaptive  filter 

we  set  equal  to  the  mean  of  the  corresponding  converged  weight  vec- 
tor that  Scheme  6 attains  in  the  absence  of  inputs.  Scheme  6A  will  au- 
tomatically produce  the  same  mean  converged  weight  vector  solutions  as 
will  be  produced  by  Scheme  6,  in  all  signal  environments. 

‘ \ 

I ' For  the  Scheme  6A  algorithm,  Y is  equivalent  to  the  power  of  each 

pilot  signal  used  in  Scheme  6.  It  is  possible  to  choose  any  quiescent 
weight  vector  desired.  To  produce  the  receiving  patterns  shown  here,  ] 

t 

^ the  quiescent  weight  vector  was  chosen  to  have  a unit  impulse  response 

‘ at  zero  delay  for  a single  filter,  and  zero  impulse  response  foi  all 

{ other  filters.  This  results  in  a truly  omnidirectional  pattern  ir.  rhe 

absence  of  any  signals  (assuming  omnidirectional  antenna  elements). 

I By  examining  the  second  form  of  the  Scheme  6A  algorithm  as  writ- 

■4 
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i 


ten  in  Figure  4,  we  may  notice  a relationship  to  the  "leaky  LMS  algo- 
rithm" described  in  [1].  The  first  two  terms  are  identical.  However, 
the  leaky  LMS  algorithm  has  a tendency  to  drive  the  weights  to  zero. 

I 

The  new  algorithm  has  a tendency  to  drive  the  weights  to  the  quiescent  i 
weight  vector.  It  is  the  third  term  in  our  algorithm,  absent  in  the 
leaky  LMS  algorithm,  that  causes  this.  Thus  the  new  algorithm  is  a 
generalization  of  the  leaky  LMS  algorithm,  since  the  leaky  LMS  algo- 
rithm can  be  obtained  from  the  new  algorithm  by  choosing  the  quiescent 
weight  vector  to  be  zero. 

To  demonstrate  that  Scheme  6A  eliminates  most  of  the  noise  in  the  ' 
weights  and  the  associated  random  modulation  problems  demonstrated 
earlier  with  Scheme  6,  Figure  5 presents  time  waveform  outputs  of 
Scheme  6A.  The  same  signals  used  with  Scheme  6,  which  resulted  in  the 
outputs  of  Figure  3,  have  been  used  with  Scheme  6A  in  generating  the  { 
waveforms  of  Figure  5.  We  note  once  again  that  the  strong  jammer  is  ' 
attenuated  rapidly,  and  does  not  display  the  noisy  output  seen  for  i 
Scheme  6.  The  weak  signal  is  attenuated  only  slightly,  and  it  does 
not  display  the  random  modulation  distortion  that  Scheme  6 induced. 
Finally,  we  note  that  the  output  response  to  the  strong  jammer  is  much 
weaker  at  the  output  than  is  the  response  to  the  weak  signal.  The  im-  | 
provement  in  output  jammer  to  signal  ratio  is  evident.  An  array  sys-  ^ 
tem  using  the  new  Scheme  6A  algorithm  and  receiving  both  information 
signals  and  jamming  signals  would  exhibit  performance  superior  to  that  i 
of  an  array  system  based  on  the  old  Scheme  6. 

In  figure  6 we  present  the  antenna  reception  patterns  attained 
when  the  weight  vector  is  at  the  convergence  point  for  the  adaptive 
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algocithms  (Schemes  6 and  6A  converge  to  the  same  expected,  or  aver- 
age, solutions  — it  is  only  their  dynamic  noise  behavior  that  is  di£ 
ferent) . It  is  clear  that  low  power  signals  are  attenuated  only 
slightly,  while  strong  jammers  receive  significant  attenuation.  The 
stronger  the  jammer,  the  greater  the  attenuation.  The  mathematical 
relationships  are  reported  below. 

In  Figure  7,  we  present  the  theoretical  curves  for  the  gain  of 
the  antenna  array  to  a single  directional  sinusoidal  input  as  a func- 
tion of  the  power  of  the  input.  Since  the  array  gain  is  also  a func- 
tion of  the  pilot  signal  power  for  Scheme  6 and  of  the  equivalent  pi- 
lot power  / for  Scheme  6A,  we  have  plotted  the  gain  curve  for  various 
values  of  pilot  signal  power  (or  equivalent  pilot  power) . 

In  figures  8 and  9,  we  present  the  receiving  patterns  for  the  an 
tenna  array  when  two  sinusoids  of  very  close  frequency  and  equal 
powers  are  received  (calculated  at  the  converged  weight  vector).  Ex- 
cept for  the  necessary  nulls,  we  see  that  the  array  maintains  approxi 
mate  omnidirectionality,  even  including  the  space  angle  between  the 
two  jammers,  where  possible.  Sharper  angular  resolution  could  be  at- 
tained, but  more  than  the  six  antenna  elements  would  be  required. 

1-D.  Definition  and  Analysis  of  Scheme  6A. 

In  this  section  we  define  Scheme  6A  and  analyze  some  of  its  pro- 
perties, to  confirm  the  statements  made  in  the  previous  section. 
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1-D-l.  Terminology,  Notation,  and  Definitions 

In  this  subsection  we  briefly  introduce  the  terminology,  nota- 
tion, and  definitions  to  be  used  in  the  remainder  of  this  section. 


There  are  k antenna  elements. 

The  output  of  each  element  is  fed  to  a transversal  filter.  The 
tapped  delay  line  of  the  filter  contains  n taps.  The  weight  vector  o£ 
the  filter  therefore  also  contains  n elements. 


The  letter  i will  indicate  that  the  quantity  is  associated  with 
antenna  element  i or  transversal  filter  i.  Thus  i can  take  on  values 
from  1 to  k inclusive. 

The  letter  j used  as  a subscript  is  a time  index,  and  indicates  a 
sample  taken  at  a specific  time. 


The  output  of  sensor  i at  time  j 


will  be  denoted 


by  x^(i) 


The  contents  of  the  tapped  delay  line  (TDL)  of  transversal  filtel 
i at  time  j will  be  denoted  by  the  vector  Xj(i)  • We  see  from  the  waj 
a TDL  operates  that 

Xj(i)  = IXj(i)  x^_j(i)  ...  x^_^^^(i)  j'*’ 

The  output  of  the  transversal  filter  i at  time  j is  denoted  by 

yj(i)  . 


The  output  of  the  entire  system  at  time  j 


is  denoted  by  y^ . 


Ws  will  need  to  refer  to  the  contents  of  all  TDL's  simultaneous- 
ly. To  do  this,  we  define  an  augmented  TDL  contents  vector  X.,  which 


20 


is  the  set  of  all  X^(i)  vectors  "stacked  up"  to  produce  one  vector. 


Thus 


-j  “ :Xj(2) : ...:x^(k) j 


Similarly,  we  define  the  augmented  weight  vector  as 

Wj  = iw^’‘(l)  ; 

We  can  now  define  the  operation  of  the  system:  Xj<i)  is  obtained 
by  doing  the  time  shift  of  a tapped  delay  line,  using  as  the  new  input 
value  Xj(i).  Thus  Xj(i)  is  just  Xj.j^d)  with  all  elements  shifted  down 
one  position  (discarding  the  bottom  element)  and  using  Xj(i)  for  the 
top  element.  The  output  for  transversal  filter  TF(i)  is  simply 

y^(i)  = W^’^(i)X^(i) 


and  for  the  entire  system  the  output  is 


Notice  that  we  have  not  discussed  how  W^  is  determined  — this  will  be 
described  in  a later  section  dealing  with  the  adaptation  algorithm. 

Vie  next  define  a covariance  matrix  for  the  contents  of  the  tapped 


delay  lines  as  R , where 


Sxx  • 


wltn  E denoting  the  expectation  operator.  V^ie  will  assume  that  the 
procwsses  Xj(i)  are  stationary  so  is  a constant  matrix.  Since  we 
will  be  referring  to  just  one  covariance  matrix,  R , we  will  denote 


r 


1 


it  by  R.  I 

i 

i 

In  the  application  of  this  array  scheme,  one  flexible  aspect  open 
to  the  designer's  discretion  is  the  shape  of  the  directivity  pattern 
that  one  wants  in  the  absence  of  input  signals,  desired  signals  or 
jammers.  This  is  the  nominal  pattern  that  will  be  notched  by  strong 
incoming  jammer  signals  as  a result  of  the  adaptive  process.  The 
weight  vector  that  provides  the  desired  quiescent  directivity  pattern 
when  no  signals  (desired  or  otherwise)  are  being  received  is  denoted 
V^,  the  quiescent  weight  vector. 

* ■ 

Lastly,  wa  define  W to  be  the  optimum  value  of  the  weight  vec- 
tor . 

l-D-2.  Per f ormance  Criterion 

/ 

The  adaptive  system  Scheme  6A  presented  in  the  previous  section 
will  be  developed  in  this  section  from  first  principles.  It  will  be 
shown  in  a later  subsection  that  this  system  and  Scheme  6 produce  the 
same  mean  converged  weight  vectors. 

We  will  first  define  a performance  criterion  for  the  adaptive 
,■  system.  In  accord  with  this  criterion,  the  current  performance  is 

I used  by  the  system  to  modify  its  parameters  to  improve  future  perfor- 

mance . 


Let  the  performance  criterion  be  defined  as: 


Recall  from  section  B that: 


y is  the  system  output 
W is  the  weight  vector 


Wq  is  the  quiescent  weight  vector 
2 


llW-V^ll*"  is  the  magnitude  squared  of  the  difference  between 


the  two  vectors. 


It  is  our  goal  to  have  the  adaptive  system  find  W such  that  J is 
minimized. 


To  gain  a clear  understanding  of  this  criterion,  let  us  first  ex- 
amine it  in  the  case  when  no  signals  are  received  by  the  system.  In 

this  case  no  input  means  no  output,  i.e.  y = 0.  So  it  is  the  task  of 

2 

the  system  to  find  W such  that  llw-^||  is  minimized.  This  is  clear- 
ly accomplished  by  setting  W = V^.  in  other  words,  the  performance 
criterion  J is  minimized  in  the  no  signal  case  by  the  adaptive  process! 
attaining  the  quiescent  reception  pattern.  j 


In  the  case  where  an  input  is  available,  the  following  tradeoff 


2 .. 


occurs:  by  making  a change  in  W,  the  magnitude  of  IIW-WqII  increases, 

2 2 
while  Ely  ) decreases.  If  the  decrease  in  Ety  J is  greater  than  the 


increase  in  IIW~WqII^,  the  performance  criterion  J is  decreased.  What 


the  adaptive  system  will  do  then,  is  find  K such  that  any  decrease 


that  would  occur  due  to  a decrease  in  Ely'^1  is  exactly  balanced  by  any 


n 

increase  that  would  occur  due  to  an  increase  in  ||w-H_|l  . What  w.- 

— -Q 


see  happening  is  that  the  system  will  attempt  to  have  W stay  close  to 


W^,  only  moving  away  when  the  output  power  Ely^)  grows  large. 


To  allow  the  system  designer  to  influence  this  tradeoff,  we  in- 
troduce a designer  controlled  parameter  / into  the  performance  cri- 


terion : 


a = Ely^]  + XI  IW-^I 


As  such,  the  designer  can  control  the  relative  tradeoff  between  E(y^l 
2 

and  l|W-W_||  in  the  performance  criterion. 
l-D-3.  Optimum  solution  to  the  problem 


The  problem  as  stated  in  the  previous  section  is  to  minimize 

J = E(y^]  + XI 


by  proper  selection  of  W.  Using  gradients,  we  can  determine  the  op- 
timum value  of  W — that  is,  the  W which  yields  the  minimum  J. 

We  begin  by  rewriting  J,  using  the  fact  that 

I IVI  = v'^v 


(for  V a vector),  and  using  the  system  equation  for  y (1-2): 

J = Elw'^XjXTwj  + K(W-Wq)'^(W-Wq) 


We  see  that  J is  quadratic  in  W,  so  that  a unique  minimum  exists.  W< 
find  this  minimum  by  setting  the  gradient  of  J with  respect  to  W to 


zero.  The  gradient  is 


V J = 2E(X^xTiw  + 2X(K-Wq) 


The  optimal  weight  vector  that  causes  the  gradient  to  be  zero  is 

* 

designated  as  W , and  is  obtained  from 


2El2ijXj)W*  + 2y(W*-WQ)  = 0 
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Recalling  that  E[XjXj]  = R,  and  gathering  terms  in  W*  yields: 

(R+/nw*  - = 0 
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Now  we  can  solve  for  W 


W*  = K(R+/I)~^Wq 


or 


W*  = 


1-12 
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So  the  optimum  weight  vector  is  a function  of  the  quiescent  weight  j 
vector  and  the  covariance  of  the  inputs  signals.  j 

l-D-4.  Compar ison  to  Scheme  ^ 

In  reference  ll]»  Scheme  6 was  also  referred  to  as  an  Adaptive  j 
Beamformer  with  Injected  Noise  (ABWIN  for  short).  It  is  now  our  goa] 
to  show  that  the  ABWIN  and  the  scheme  just  presented  yield  the  same  ^ 
converged  mean  weight  vector  . Let  us  denote  the  converged  mean  weighlj 

* 

vector  for  the  ABWIN  as  Then  [IJ  showed  that 

1-14 


25 


4 


where  the  R is  the  same  as  we  have  defined,  is  the  power  of  the  in- 
jected noise  used  for  the  pilot  signal  for  the  ADWIN,  and  P is  the 


correlation  between  the  contents  of  the  tapped  delay  lines  (X^l  and 


the  pilot  signal.  This  can  be  rewritten  as; 


-ABWIN  “ t 2^  i)  2 - 

% °^n 
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In  (1),  in  the  earlier  sections,  it  was  shown  that 


i P = (1  0 011  0 01. ..II  0 
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and  that  the  quiescent  weight  vector  for  the  ABWIN  was  ^ P.  In  a 


later  section  of  [11,  a method  was  proposed  for  altering  the  pilot  | 


signal  formation  so  that  any  value  for  the  cross-correlation  vector  P' 

I 

could  be  attained,  and  — P would  be  the  quiescent  weight  vector. 


Thus  we  showed  in  [1]  that 


-ABWIN 


(ilt  + I ) "^W 

a ''ABWIN 

n 
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where  W = P could  be  chosen  beforehand  by  the  system 

ABWIN  "* 


designer.  Now  if  we  compare  our  new  system 


W*  = (yR  + 
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with  the  above  relation  for  the  ABWIN,  we  see  that  W*  - if  we 


make  the  assignments  V ^ I^q  -abwIN*  system  can 


• •A 


obtain  the  same  solution  weight  vectors  as  the  original  ABWIN 


l-D-5.  Adaptation  Algorithm 


It  remains  to  present  the  adaptive  algorithm  itself.  The 

I 

development  follows  directly  the  development  of  the  LHS  algorithm,  ; 

which  is  a steepest  descent  algorithm.  : 

i 

I 

The  basic  idea  is;  assume  we  have  a weight  vector  at  time  j.  ; 
We  want  to  find  a weight  vector  for  time  j+1  that  is  closer  to  the  op- 

I' 

timum  weight  vector.  To  do  this,  we  compute  the  gradient  of  J with  i 

respect  to  W,  and  evaluate  it  at  the  current  weight  vector  W ^ . This  | 

gradient  (denoted  V J)  defines  the  direction  that  W.  should  be  altered 

W 

to  increase  J.  Since  we  are  interested  in  minimizing  J,  we  go  the  op- 
posite direction.  Mathematically,  we  set 
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where  p governs  how  far  in  the  direction  specified  by  V J we  go.  (If 

W 

H is  too  large,  we  could  overshoot  our  goal  so  much  that  J increases 
ag  a i n ! ) 


From  section  l-D-3  we  already  have  an  expression  for  V J'- 

W 

V J = 2R  W . + 2/(W.-^) 

D -3  -Q 
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Using  this  in  the  expression  above  (1-1*#)  we  obtain 

Wj+1  “ iij  ■ 
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• * •.  A - « 


Now  in  general  we  do  not  know  R.  Instead  we  use  an  instantaneous  but  j 

i 

unbiased  estimate  of  R.  The  estimate  is  XjXT.  Using  this  in  the  above 
expression  we  obtain  \ 


SjH  = Wj  - - 2,jy(W.-WQ) 
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Now  since  = xTw^  (1-2)  we  have 


Wj+1  = W . - 2uy  .X.  - 2*j)^(W.-Wq) 
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which  may  also  be  rewritten  as 


= (l-2pK)Wj  - 2uyjX^  + 2u)^ 
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This  is  the  adaptation  rule  used  in  Scheme  6A. 
l-D-6.  Convergence  of  the  Adaptat ion  Rule 

We  must  now  demonstrate  that  the  adaptation  rule  presented  in  the 
previous  section  converges,  and  that  it  converges  to  the  optimum 
weight  vector.  The  quantity  we  will  study  to  indicate  convergence  is  , 
the  mean  of  the  weight  vector.  Other  criteria  are  possible,  as  in  sto-i 
cnastic  approximation  techniques.  However,  many  algorithms  based  on 

j 

stochastic  approximation  have  a tendency  to  "turn  themselves  off"  | 

after  a time  span,  ignoring  later  data.  While  this  may  be  suitable  | 
for  a truly  stationary  environment,  it  does  not  allow  any  capability  | 
for  following  changes  in  a nonstationary  environment. 

First  we  will  show  that  with  a stationary  input  environment,  if 
the  algorithm  converges,  the  mean  of  the  weight  vector  has  only  one 
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point  to  converge  to — the  only  stationary  point  of  the  performance 
criterion  J,  which  is  therefore  the  optimum. 


To  find  the  stationary  point,  take  the  expectation  of  both  side! 
of  the  adaptation  rule  (1-23) : 


Now,  at  convergence,  (which  has  yet  to  be  demonstrated)  we  would  hav 


Thus  we  write: 


2p  lim  EIX.X^W.)  - 2u)^(W  -W^) 
j->oo  - -a 


where  we  have  reexpanded  y.  as  x:w.  (1-2).  Continuing 


where  we  have  assumed  that,  with  K 
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which  is  the  optimum  solution  found  in  section  D. 


We  must  next  show  that  the  adaptation  rule  causes  E[Nj]  to  con- 


verge to  a single  value,  which  must  necessarily  be  the  stationary 
point  found  above.  Since  the  proof  of  convergence  is  directly  paral- 
lel to  that  of  the  LMS  algorithm,  and  is  rather  lengthy,  we  will  not 
produce  it  here,  but  will  point  out  the  modifications  needed  to  the 
proof  of  convergence  for  the  LMS  algorithm.  (A  proof  of  convergence 
of  the  LMS  algorithm  is  contained  in  references  5 and  6).  The  major 
difference  is  that  the  term  which  appears  as 

II+2k^  J 

in  reference  6,  must  be  modified  to  be 

II  + 2k^yi  + 2kg^  1 = l(l+2kgK)I  2kg^  1 ^ 
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Notice  that  the  eigenvectors  in  matrix  Q have  not  changed.  (Also  notj 


that  k in  (61  corresponds  to  p in  this  report) . 
s 


The  other  change  required  is  the  replacement  of  the  term 


by  2k^KWQ. 


With  these  modifications,  the  proof  of  convergence  follows  the 
same  steps  leading  to  the  conclusion  that  the  adaptation  rule  causes 


E[Wjl  to  converge  to  the  optimum  solution  so  long  as 


'max 
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where  X is  the  maximum  eigenvalue  of  the  matrix  R. 
''max  ~ 
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l-D-7.  Response  of  Scheme  6A  to  single  sinusoids 

In  this  subsection  we  analyze  the  gain  that  a single  sinusoid 
impinging  on  a Scheme  6A  array  would  encounter. 

We  represent  the  sinusoid  being  received  at  the  individual  anten- 
na element  as  a phasor . Let  us  denote  the  phase  of  the  sinusoid  at 
antenna  element  i as  Let  the  phase  difference  of  the  sinusoid  at 

two  adjacent  elements  of  a tapped  delay  line  be  G.  If  the  sinusoid  has 
2 

power  then  may  be  written  as: 


represent  all  weight  vectors  as  vectors  of  n/2  complex  weights,  and  X 


as  a vector  of  n/2  complex  samples,  with  autocorrelation  matrix 


£x.  ■ "s!'  £* 
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(where  V denotes  the  complex  conjugate  of  V) . 


Using  this  notation,  we  can  express  the  expected  output  power  of 


the  array  for  a single  sinusoidal  input  as: 


E(y^J  » V^W 
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for  any  steering  vector  V,  signal  power  and  weight  vector  W. 

O 


Now,  if  adaptation  is  not  allowed  and  the  weight  vector  is  set  t^ 


an  initial  vaxue  W^,  then  the  expected  output  power  is: 


Ely^l 


W=^ 


y.\ 
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Consider  next  the  expected  output  power  at  convergence.  We  have 


shown  that  the  weight  vector  at  convergence  is: 


* R -1 

w = (y  + 1)  \ 
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Thus,  we  have 


* "s  + -1 

U = + 1) 
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By  applying  the  matrix  inversion  lemma  (Theorem  5.22,  reference  7J  w«| 


Can  obtain 


V + I)  * 


. — j.  — 


- I - 


1 + 


y-  - 


1 + -py\ 
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Now,  from  the  definition  of  V,  we  can  see  that 

y\  = I lyl 


1-40 


(recalling  that  k is  the  number  of  antenna  elements,  and  n/2  is  the 
number  of  taps  in  each  tapped  delay  line  (complex  samples)).  Let  us 
define  N — nk/2.  Then  we  can  use  these  formulas  to  give  us  a con- 
verged weight  vector  of 

. I 4..1 


1 + -y  N 


Now  we  may  compute  the  expected  power  output  at  convergence  (using  W 


in  1-35) : 


Ely^l 


2 *+  + * 
= aw  V V w 


I 1 + -7-  N (1  + ^ N, 


Thi&  ccn  bt  rewritten  (usiny  l-3b)  as: 


2 


Ely^j 


Ely^J 


1 + N 


W=^ 
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Thus  we  see  that  the  expected  output  power  of  the  array  at  convecgencej 
is  the  expected  output  power  of  the  array  initially,  multiplied  by  an  | 
attenuation  factor.  This  factor  is  always  less  than  (or  at  most  equal] 


to)  one  since  N ^ 0.  This  attenuation  factor  is  independent  of  the] 
antenna  geometry,  arrival  direction  of  the  sinusoid,  and  of  the  quies-i 


cent  weight  vector.  The  attenuation  factor  depends  only  on  the 


sinusoid's  power  (o-^)  , the  total  number  of  taps  in  the  array  filters 
(N),  and  the  equivalent  pilot  noise  power  (Y)  . Thus,  if  we  know  the 


response  of  the  quiescent  unadapted  array  to  a single  sinusoid,  we  can! 
easily  calculate  its  response  at  convergence  of  the  adaptive  process,  j 


1-E.  Conclusions  of  Part  1 


We  have  proposed  and  studied  a new  adaptive  algoritho  which  has 
been  designated  Scheme  6A.  It  is  related  to  the  leaky  LMS  algorithm  ^ 
previously  studied.  When  applied  to  an  antenna  array,  it  yields  a 
method  of  antijamming  based  on  attenuation  of  received  signals  on  the  * 
basis  of  their  input  power  levels.  No  a priori  knowledge  of  the  signal 
characteristics  is  required.  This  algorithm  replaces  a previously 
studied  algorithm.  Scheme  6.  It  exhibits  improved  noise  behavior  and 
reouires  less  hardware  for  implementation. 


PART  2 


ANALYSIS  OF  ADAPTIVE  ViEIGHT  NOISE  COVARIANCE 

2-A.  Introduction 

J 

Previous  work  [1]  introduced  the  concept  of  using  an  adaptive  | 
line  enhancer  [8,  9]  to  separate  signals  by  power  level.  Although  the' 
original  proposal  required  injected  noise  and  'slave'  filters,  a re-  i 

i 

fined  version  was  developed  that  eliminated  the  need  for  injected 
noise  by  replacing  the  LMS  adaptive  filter  with  a 'leaky'  LHS  filter. 
Because  an  adaptive  line  enhancer  using  the  'leaky*  LMS  algorithm  can 
separate  signals  by  power  level  it  is  called  an  adaptive  power  separa- 
tor (APS). 

During  the  past  year  we  have  been  engaged  in  analysing  the  per- 
formance of  the  APS.  Performance  in  the  mean  has  already  been 
described  in  (I)  ; however,  performance  in  the  mean  does  not  complete- 
ly characterise  an  adaptive  filter.  Specifically  it  is  important  to 
know  about  the  noise  in  the  weights  since,  by  a modulation  process, 
weight  noise  causes  noise  components  in  the  filter  output  [9,  10] 
which  degrades  the  performance  of  the  APS.  The  first  step  is  to  charac- 
terise the  variance  of  the  noise  in  the  weights. 

Analysis  of  weight  noise  covariance  has  proceeded  in  four  main 
phases : 

1)  a deterministic  analysis  with  the  input  consisting  of  a sinusoid 

2)  a statistical  analysis  with  the  input  consisting  of  a sinusiod 
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3)  statistical  analysis  with  the  input  consisting  of  only  noise  and 
then  approximate  extensions  to  sinusoids  in  noise 

4)  exact  analysis  of  a single  weight  APS  for  comparison  with  the 
previous  approximate  analyses. 

Figure  2—1  depicts  the  APS  and  helps  to  define  the  Quantities 


weak  signals 


ADAPTIVE  POWER  SEPARATOR 
Figure  2-1 


used  throughout  this  section: 

dj  is  the  system  input  at  time  j 

Xj  = is  the  filter  input  at  time  j 

yj  is  the  filter  output  at  time  j 

Cj  is  tne  'error'  signal  at  time  j.  This  signal  is  used  to  modify, 
or  update,  the  filter  weights  according  to  the  'leaky'  LM3  al- 


SL 
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gor ithm. 


The  operation  of  the  ‘leaky*  LMS  (LLMS)  filter  is  defined  as  follows: 


If  L»  length  of  filter  (number  of  weights) 
W=  weight  vector  = (w^, W2,  . . . 


S=  state  vector  of  filter  =(x.,x.  ,,...,x.  , . , J 

3 j-i.  3-ij+i 


then 


y.=w'^S  = 5 w.x.  . 

J i=l  ^ 


i+1 


2-1 


2-2 


Wj  + 1 = (/  W.+2u€jS  . 

U = a constant  controlling  rate  of  adaption 


2-3  -i 


{/  = the  'leak*  factor  (generally  less  than  1) 

= l-2ny 

2-4 

y = the  equivalent  injected  noise  power.  That  is,  the  effect  of 

I 

the  leak  is  the  same  as  adding  noise  of  power  y to  the  input  I 
and  then  using  a conventional  LMS  filter.  (Note:  LMS  is  a spe^ 
cial  case  of  LLMS  where  {/  =1) 

To  characterise  the  average  performance  of  the  APS  we  have  to  in* 
troduce  several  new  quantities  which  define  the  composition  of  the  in« 
put  signal  6^  : 

2 , _ • 

O’  = power  of  input  noise 
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ff  +y  = effective  power  of  input  noise 


p » power  of  input  sinusoid 

SNR'  * — ^ = effective  signal  to  noise  ratio 
o' 


APS  used  to  reject  low  powered  inputs 
Figure  2-2 

filter  output,  y^,  versus  SNR'  (see  figure  2-2).  Alternatively  we  c< 
draw  the  gain  curve  from  the  input,  d^,  to  the  error  output,  € j , 
versus  SNR'  (see  figure  2-3)  . 

Thus  to  discriminate  against  weak  signals  we  use  the  y output, 
and  to  discriminate  against  strong  signals  we  use  the  € output.  Not( 
that  SNR'  can  be  varied  by  selection  of  (/since: 


2-B.  Deterministic  Analysis  of  Sinusoidal  Input 


One  case  of  interest  is  the  behavior  of  the  APS  when  the  input 
consists  of  a sinusoid  and  little  or  no  noise.  This  might  occur  in 
practice  if  an  APS  were  used  in  a jam  resistant  mobile  communication 

system  and  the  base  station  were  close  to  the  mobile  receiver,  or  the  | 

i 

mobile  receiver  were  very  close  to  a powerful  narrowband  jammer.  By  j 

I 

assumption  the  sinusoidal  component  of  the  input  is  either  the  desired  j 
signal  (say  narrowband  FM  or  AM)  or  a narrowband  jammer  — the  differ-  ! 
ence  is  power  level. 

For  this  case  we  let  the  delay,  A/  be  one  unit  and  so:  ! 


dj  = a cos[9j] 

Xj  = a cos(©j-0J 

e = wT 

w = frequency  of  sinusoid 
T = sampling  interval 
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I 

I 

I 

2-7  i 
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From  previous  analysis  of  the  mean  performance  (IJ  we  know  that  the 
output  will  be  approximately: 


y . = b cos[0j} 
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Substituting  for  d^  and  y^  in  equation  2-2  yields; 
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a (a-b)  cos[ej| 


2-10  i 


Using  this  we  compute: 


a-b 


(€^S^)i  = {cos(9i] +cos[20j-0i]  ) 
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Notice  that  the  first  term  of  equation  2-11  is  not  a function  of  time 
j,  only  of  weight  index  i.  The  second  term  is  a function  of  time  and  j 


weight  index.  In  previous  analysis  of  the  APS,  when  the  mean  perfor- 


1 


mance  was  desired,  the  second  term  was  ignored  on  the  basis  that  it  t 

,v 

"averages  out"  over  a period.  Hence  only  the  first  term  contributes  | 

\ 

to  the  mean  weight  vector.  Indeed  the  mean  value  of  the  weight  vectorl 
can  be  found  by  using  only  the  first  term  of  equation  2-11.  Ke  see  I 
that  the  second  terra  causes  time  changes  in  the  weight  vector  and 
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input 


Weight  perturbation  model  of  an  LLMS  filter 
Figure  2-4 


nonproductive  and  causes  output  distortion.  To  determine  the  weight 
variations  of  the  weight  error  filter  we  apply  the  "bad"  update  terra 
to  the  LLMS  update  scheme  (equation  2-3) . 


To  make  the  problem  solvable,  note  that  equation  2-3  can  be 
Z-transformed  to  give: 


W.^1  = 


(Z-(/  )W(Z)  = 2pG(Z)S(Z) 


W(Z) 


. 2u 

6(Z)S(Z)  Z^ 


2-12 


Since  the  input  to  the  system  defined  by  equation  2-12  is  a sinusoid 
we  know  that  the  output  will  be  a sinusoid  of  the  same  frequency. 
The  complex  gain  of  the  difference  equation  at  this  frequency  is: 


1 


^20  “ 3207 


2m 


The  amplitude  of  the  weights,  Wg,  of  the  weight  error  filter  will  be; 

a-b,_  , 

2 ’^20* 
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Figure  2-5  shows  I929I  ^s.  0 for  a variety  of  (/'s.  Using  equation  2-1 
we  can  compute,  in  the  time  domain,  the  output  of  the  weight  error 
filter  as: 


i=l 

L 


= 5^{^lg29lCOS(20j-0i+;Sl  l{aCOSl0j-0il  } 

= S^l{cosl0j-0]+COSl30j-20i+^)  ) 

= a(a-t^[^H^  cosiej-;5)+^-^-^^|g20l  5 cos  [ 30  j-29i+^51 


i = l 


2-14 


Wh.rc.  . = AKG,9,^,  = 

The  first  term  of  y^j  is  at  the  same  frequency  as  the  desired 
output  and  has  amplitude  arap^  = ^ I g2Q  I L,  We  note  that  b £ a,  so 

a^L 

a-b  £ a which  implies  amp^  £ —^1929'  ' this  can  be  made  arbi- 

trarily small  by  selection  of  m which  controls  1929!  unless  0 is  very 
small.  If  we  restrict  our  attention  to  a reasonable  range  of  frequen- 
cies, say  2u-Su'*  of  Nyquist  (see  also  (tij  where  Treichler  makes  this 
same  assumption  in  analysing  the  mean  performance),  then; 


a^L 


3a^L 


U IJ  I I ^ 


VC' 


2-15 
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5i 


frequency  (as  % Nyquist) 

Gain  vs.  Frequency 
as  a function  of  leak 

Figure  2-5 


The  second  term  of  2~14  will  cause  an  output  at  three  tiroes  the 
original  frequency.  While  the  expression  for  the  amplitude  is  rather 
complicated  we  can  easily  bound  it: 

L 

S cos[  39j-2ei4^|i]  < L 


2-16 


from  which  we  see  that  the  amplitude  of  this  third  harmonic  distortion 
is  also  bounded  by  equation  2-15. 


Looking  at  the  filter  model  (figure  2-4),  we  notice  that  the  out- 
put of  the  weight  error  filter,  which  is  part  of  the  total  filter  out- 
put, was  not  subtracted  from  the  desired  signal  d..  If  Ye  were  sub- 
tracted  from  d^  as  well  as  it  would  cause  a new  component  in  the 
error  signal,  e^,  equal  to  -y^.  To  account  for  this,  another  weight 
error  filter  should  be  added.  This  filter  is  updated  using 


Wj-2pygSj  and  causes  a new  output  which  will  have  terns  i 
at  the  fundamental,  third  harmonic  and  fifth  harmonic.  These  outputs  I 
contribute  to  and  so  on.  However,  note  that  yg  can  be  made  arbi-  | 

trarily  small,  and  ye2  1 ' ^20 ' ' ^40  ' ^ ^ ' ^20 ' ' ^40^  * 

weakness  of  this  analysis  technique  becomes  apparent  here.  Previously  | 
we  restricted  1920*  selecting  a reasonable  range  of  values  for  ©. 
Similiatly  we  could  select  a range  of  0 to  restrict  Ig.^^l.  But,  it  is 
evident  that  yg2  will  give  rise  to  other  error  terms  which  will  cas- 
cade to  create  an  infinite  number  of  error  terms  of  all  different  fre- 
quencies. Some  of  these  error  terms  must  surely  have  very  large  |g| 
since  they  will  be  near  some  multiple  of  the  sampling  frequency.  How- 
ever, experimental  results  indicate  that  if  G is  between  20«  end  80% 
of  Nyquist  frequency,  then  the  only  output  component  of  any  signifi- 
cance is  the  third  liarmonic.  Hence  for  practical  purposes  only  the 
first  "weight  error"  filter  needs  to  be  analysed. 
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Computer  simulations  were  performed  to  verify  these  analytic 
predictions.  The  frequency  of  the  input  sinusoid  was  set  at  4%  of  Ny- 
quist.  The  results  are  graphed  in  figures  2-6  through  2-11.  Each 
plot  shows  percent  power  not  at  the  fundamental  versus  p.  Thus  each 
plot  relates  total  distortion  power  to  From  2-6  we  see  that  in  all 
cases  the  total  distortion  power  was  less  than  0.2%  of  the  output 
power  at  the  fundamental  frequency.  From  2-7  we  get  the  same  shape  of 
curve  but  now  the  total  distortion  is  less  than  0.06%  of  the  desired 
output  power.  In  2-8  the  fundamental  frequency  has  been  increased  to 
8%  of  Nyquist.  The  error  power  is  substantially  lower  than  for  the 
previous  cases,  as  is  to  be  expected. 

In  an  attempt  to  stress  the  APS  to  cause  significant  distortion, 
three  simulations  were  run  in  which  the  fundamental  frequency  was  1% 
of  Nyquist  as  opposed  to  being  in  the  20-80%  range.  The  results  are 
plotted  in  figures  2-5,2-10  and  2-11.  Note  that  the  greatest  observed 
distortion  power  is  4%  of  the  power  of  the  desired  signal. 

A final  point  to  consider  is  at  what  frequencies  the  distortion  j 
power  occurred.  Analytic  efforts  indicate  that  the  3*^^  harmonic  i 

should  be  dominant.  In  fact,  the  simulations  supported  this.  Even  ! 

I 

when  the  fundamental  frequency  was  1%  of  Nyquist,  over  98%  of  the  dis^ 
tortion  power  was  in  the  3*^*^  harmonic. 
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Filter  length  64  weights 
V = 0.95 

Input  frequency  1%  of  Nyquist 
Numbers  in  ( ) denote  power 
gain  at  input  frequency. 


2-C.  Statistical  Analysis  oE  Sinusoidal  Input 

From  previous  work  (IJ  the  general  form  of  tha  APS  output  is 
known.  If  we  use  equations  2-6,7  & 8 to  define  the  input,  then  we 
know  that  the  output  will  be  approximately; 


Yj  = bCOSOj)  = S- C0S[8j] 


1-h 


L SNR' 


If  we  define  AWj  as  W^-E{W} 


and  then  notice  that  (1-C^)E{W}  = E{2jjGS}, 

so  by  taking  the  expectation  of  2-3  and  2-18  we  get; 


2-1 


2-2 


hence 


ZSi'J  = (^Zi5'ij  + 2uGjS^-E(2uGjS^} 


AW(Z) 


2pG(Z)S(Z)  z-(/ 


2-3 


but  if  we  know  VAR{2pGjSj}  then  we  know 


VAR  {AW j)  = |^|^VAR{2p6jSj} 


2-4 


VAR{2uG.S.  } = VAR{2u[aCOS(0j) ^ C0SOj)]S.} 

J J 1 + ± 3 

L SNR' 


' cos(9j)Sjl 

^ T 1 


(VAK{2uG.S.  })  . = VAR{  (COS  [S  j ) ) (aCOS  {0  j-Gi) ) } 


3 3 1 
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2-5 


8 


Thus 


(VAR  = 


11 2 


__mV_ 

2(H.k_SNRl)2 


z-(/|  2(i+kS^)2 


1 _iiV__ 


These  formulae  are  in  close  agreement  with  experimental  results 
as  Table  2-1  shows.  In  the  cases  where  w is  12.5%  of  Nyquist,  there 
is  a 15%  error  in  determining  VAR{2pe^S^},  although  VAR(A  W}  is  still 
given  by  equation  2-ly  if  we  use  the  observed  value  for  VAR(2pGjSj}. 

To  summarise  we  used  a simple  statistical  analysis  to  determine 
the  variance  of  the  driving  function,  2pGjS^  (equation  2-21).  Then  we 
considered  how  this  affected  the  weight  vector  (equation  2-19)  and 
derived  a relationship  (equation  2-22)  for  the  weight  variance  in 
terms  of  the  input  quantities.  These  equations  (2-21  & 22)  will  give 
a good  idea  of  the  weight  variance  (note  VAR{Wj}  = VAR{  A^jl)  provid- 
ing the  input  frequency  is  not  to  near  DC.  A reasonable  range  of  in- 
put frequencies  appears  to  be  from  20%  to  00%  of  Nyquist. 
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2-D. 


Statistical  Aalysis  of  the  Adaptive  Power  Separator  (APS)  with 
Noise  Input 

In  a real  communication  environment  the  input  to  an  APS  might 
well  consist  of  both  sinusoidal  components  (either  signal  or  nar- 
rowband jammers)  and  broadband  noise  (thermal  noise  or  wideband  jam- 
mers) . Thus  we  wish  to  understand  the  behavior  of  the  APS  to  a 
sinusoid  in  broadband  noise.  The  first  step  is  to  characterise  the 
weight  vector  variance  when  the  input  consists  only  of  noise. 


Note  that: 


VAR{X)  *=  E{XX^}-E{X}E{X} 


2-7 


also 


dj-n. 


where 


n^  is  from  a white,  zero-mean  Gaussian  process  with  variance  a^. 


2-8 


From  equations  2-2,3  & 4 


Wj  + i*  (I-2pK'I-2pSSMw^  + 2pd^S^ 


2-9 


T j 

If  we  assume  E(SW  ) - 0,  which  is  a common  assumption  (well  supported 


by  experience  if  p is  small  enough),  then  we  find: 


2-10 


ElW^^l}  = W « (I-2iiyi-2*icr‘l)Wj  + 0 


VARlWj^j)  - 

*=  (1-2*1/)  ^VAR{W^}-4*j(l-2n/)a^VAR{Wj}+4*i^a^I 
+ 4*1^E{SS'^VAR{W^}SS’*^} 

= (l-4*i/+4*i^/^-4*io-^+8*j^/a^)  VAR{W^)  + 4*i^a^I+0 


Where  we  have  assumed: 


*iE{Ss‘^VAR{W^lSs'^)<<a^VAR{W^  } 


2-11 


2-12 


If  we  now  assume  steady  state  so  that  VAR{V}j) 


VAR{Wj^j^),  then; 


VARIW)  = ^ 


4*1  V 


2 ..2  2.,_2^ 


4*ia‘+4*i/+4*i  / -6*1  /a 


a a 


-5 


2-13 


2 

Providing  *a/<<l+-^  end  *J-^<<1+-^ 


a CT 


4 


1 1 

= > *j<<y+-^  eno  *i<<-p+-p^ 


2-14 


4 


earlier  analysis  19]  of  the  LMS  filter.  Also  note  that  the  'leaky' 
algorithm  never  increases  the  weight  variance,  in  fact  it  actually 
reduces  the  variance.  This  supports  the  conjecture  11]  that  algo- 
rithmically simulated  noise  (via  'leaky'  LMS)  is  more  desirable  than 
actual  noise  injection,  even  though  the  converged  mean  weight  vector 
solution  is  the  same  in  both  cases. 

In  equation  2-26  we  assumed  that 

*iE{33'^VAR{W}Ss'^}<<a^VAR{W} 


To  check  this  assumption  we  note  that: 


E(Ss’^VARlW)Ss'^}  = O^VARIW)  + o'^Diag  [ VAR  {W} ) + a^Tr  ace  IVARlW}]  I 

2-15 

where  Diag [ . ] means  the  matrix  consisting  only  of  the  diagonal  ele- 
ments of  the  operand. 

Assuming  that  2-29  is  substantially  correct  leads  to  the  following 
conclusion : 


Therefore  2-28  requires: 


r 


4 


4 

I 


which  implies  p<<^ 

cr 
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This  condition  is  often  assumed  in  adaptive  filtering  and  it  im- 
plies slow,  low-noise  adaptation. 


Extension  to  the  case  of  a sinusoid  in  noise  is  unfortunately  not 
obvious.  Intuitively  it  is  appealing  to  argue  that  the  correct  formu- 
la should  be: 


VAR{W}  = 


1+^-iL- 

^min 


by  analogy  with  the  conventional  LMS  formula  of: 


VAR(W)  = 


Experiments  indicate  that  this  is  not  the  case,  in  fact  it  is  ’ 

easy  to  see  that  this  would  not  be  true  since  in  the  no  noise  case  the  i 

\ 

formula  is  substantially  incorrect.  j 


Another  approximation  assumes  that  the  noise  and  sinusoid  affect 
the  weights  independently,  which  results  in  the  curve  of  figure  2-12. 


This  approach  is  not  strictly  correct  either.  However,  if  the 
weight  variance  due  to  noise  alone  is  substantially  greater  than  the 
variance  due  to  the  sinusoid  alone,  then  tne  formula  is  indicat  ive  of 
the  actucAl  variance.  This  result  has  been  checked  experimentally,  and 
some  results  arc  presented  in  Table  2-2.  An  important  point  to  con- 
sider is  that  computing  weight  variance  by  using  the  formula: 
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combined 

variance 


variance  due 
to  noise  only 


variance  due  to 
sinusoid  only 


noise  power 


Weight  variance  obtained  by  assuming  independent  effects  of 
noise  and  sinusoid 


Figure  2-12 


VAR{W)  = *i(error-output-power) 


VAR{W)  = 

1+ 1 

(er ror-output-power ) 

(as  was  done  in  (10)  for  example)  is  apparently  very  conservative. 
The  power  due  to  sinusoidal  components  does  not  contribute  to  weight 
variance  as  much,  proportionally,  as  power  due  to  rcndom  components, 
are  currently  working  to  quantify  this  effect. 


’I 


noise 

power 

1-Y 

y 

weight 

variance 

approx.  #1 

approx.  #2 

1.17x10"^ 

10"^ 

10-3 

3.27x10"® 

9.31x10"® 

1.37x10"® 

1.0 

2x10'^ 

5x10"^ 

1.75x10"^ 

3.27x10"^ 

-4 

2.5x10 

1.0 

10"^ 

5x10'^ 

5.67x10"® 

3.27x10"^ 

2.5x10"® 

1.0 

10"^ 

5x10"^ 

2.56x10"^ 

3.27x10"^ 

2.5x10"^ 

1.0 

10-3 

10-^ 

5.81x10"^ 

6.55x10"^ 

5.0x10"^ 

5x10'^ 

10"3 

10-3 

1.29x10"® 

9.18x10"® 

2.5x10"^° 

Frequency:  25%  of  Nyquist 
Power  of  sinusoid:  1.0 
Number  of  weights:  20 

yC*  • 

approx.  #1  VAR  = 

1+  

y O* 

approx.  #2  VAR  = 

U-JL- 

o" 

Table  2-2 

Comparison  of  measured  weight  variance  and 
two  approximate  expressions 
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The  Single  Weight  Power  Separator 


' 


i 

4 

'I 


i 


4 

1 


Pi. 


If 


Analysis  of  a single  weight  adaptive  power-separator  is  of  great 
interest  for  many  reasons.  Among  them  is  that  a complete  analysis  can 
be  performed  with  no  need  for  approximations.  in  this  report  the  mean 
weight  value  and  weight  variance  are  analysed,  which  leads  to  some 
surprising  results  that  further  illuminate  the  performance  of  an  LHS 
filter.  The  results  show  that  previous  approximate  analysis  of 
multi-weight  filters  by  Widrow  [9,  lOJ  , Senne  [11]  , Brown  [12)  , and 
Davisson  [13]  to  name  a few,  are  accurate  enough  for  useful  results  in 
most  cases,  with  the  greatest  errors  occurring  during  fast  adaptation. 

The  configuration  of  the  adaptive  power-separator  is  a leaky-LMS 
filter  in  a line-enhancer  as  shown  in  figure  2-1.  Note  that  in  this 
case  Wj=Wj  has  a single  element;  and  S^=Xj,  a single  element.  The  in- 
put, d^=nj,  is  composed  of  a DC  value,  a,  which  is  the  'signal';  and 

2 

white,  zero-mean  Gaussian  noise  with  variance  ct  . Physically  this  may 

2 

be  thought  of  as  a degenerate  (zero-frequency)  sinusoid  of  power  a in 

2 

noise  of  power  a . 


value  as: 

N-1  N _ 

+ 2|i  i E{n._  n.  U «/  ) ] 

i=0  j = i+l  -* 

^ 2 

+ W E{  n ((/  -2nnf  -)} 
j=0 


2-19 


Using  the  following  properties  of  white,  Gaussian  noise  with  the  de- 
fined parameters: 


Eln^n^}  = 


2^  2 
a +a 


i = j 


Etf (n. ) f (n^) } = E{f (n.) }E{f (n^) } if  i^j 
we  get: 

2 N-1  2 ^ 2 

= 2pa^  + 2p  i [aE{n.  ((/  -2pn;)  ) fl  E{C^-2pnt  ,)1 
i=0  ^ ^ j=i+2 


^ 2 

+ W n E{(2  -2unf  } 

j=0  J 


2 ^ 2 ^ 2 2 

2ua  + 2p  S [a  (aO^  -2Ma^-6pcr^a)  H ((/’  -2po'^-2pa'^)  1 

i=0  j=i+2 

” 2 2 
+ W,  n ((/  -2ua^-2uo-^) 

j = 0 


N-i 

2pa^  + 2p  5 ( (a^(/  -2ua^-&pa^a^)  (C/  -2Mcr^-2pa^)^~^“^l 
i = 0 

,,  ~ 2-  2.N  + 1 

+ VJ^  ( {/  -2>ja  -2pa  ) 


= 2pa ' 


2 4 2 2 

2p(a^(/  -2pa^-6po'^a^) 


1-(C^  -2pg^-2ua^)^1 

1-1/  +2u(a^+a^)  J 
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2-20 


2,N+1 


+ Vi  ((/  -2|ia  -2Mcr^) 


This  equation  (2-36)  expresses  the  mean  value  of  the  weight  as  a 
function  of  the  amount  of  data,  or  time,  used  in  adaption.  An  in- 
teresting result  is  the  final  mean  value  of  the  weight.  We  see  that 
if  I (/  -2pa  -2pa  |<1  then  the  adaptive  process  is  stable  (convergent), 
and  so  we  can  find: 


lira  E{W^}  = 2ua2  + 

N->oo  l-(/  +2pa^+2ua^ 

2 2 2 
= a‘^-4ucr  a^ 


2-21 


The  Wiener  solution  (minimum  mean-square-error)  for  the  converged 
weight  value  can  be  shown  to  be: 


2 2 
a +CT 


2-22 


The  adaptive  power  separator  based  on  the  leaky  LMS  algorithm  gen- 
erates a converged  solution  sirailiar  to  a Wiener  solution  for  a prob- 
lem  in  which  the  variance  of  the  noise  is  a +— However,  the  adap- 
tive solution  given  by  equation  2-36  is  not  quite  equal  to  the  Wiener 

-4^2 

solution  since  there  is  an  extra  term  of  ■ ^ . — . Senne  [11] 

demonstrated  by  experiment  that  LHS  filters  do  not  converge,  in  gen- 
eral, to  a Wiener  solution  if  tlie  inputs  are  correlated,  and  since  the 
input  has  a DC  component  it  is  correlated  over  time.  Still,  we  note 


6/ 


that  if  *i<< — j the  adaptive  solution  will  be  essentially  the  Wiener 
solution . 

To  reconsider  the  conditions  under  which  we  can  find  the  limiting 
value  of  the  weight,  we  note  that  (/  is  chosen  in  the  range  0 < ^ < 1 
for  normal  use,  and  hence  from  the  convergence  conditions  that: 

I {/  -2p<T^-2pa^  1 <1 


P < 


2 2 
2 (CT^+a"^) 
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will  guarantee  that  the  mean  weight  value  converges.  Note  also  that 

2 2 k 

transients  die  geometrically  as  {i/  -2na  -2iio'  ) . 

While  the  average,  or  expected,  solution  is  very  useful  in  under- 

1 

1 

standing  the  behavior  and  utility  of  the  filter  (see  for  example  pre-  | 
vious  final  report  [1)  ),  it  is  not  the  complete  story.  In  this  sec- 
tion we  shall  analyse  the  variance  of  the  single  weight.  From  this 

f 

I information  we  can  determine  how  much  extra  noise  (misad j ustraent  (1)) 

I appears  in  the  output  due  to  the  adaptive  process.  Also,  we  will  find 

a new  convergence  criterion. 

2 

The  first  step  is  to  find  the  mean-square  value  of  the 

weight.  Knowing  this,  we  can  determine  the  variance  of  the  weight  by 
using  the  following  formula: 

2-24 

For  N^3  wc-  can  show  that: 

i 
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4*jWQaqs^  + 4iJ^pvj^i^j  + 8p  ^aut  j 

8M2,q2 Jl-r^-^  s^-l-sr^-2l  , ^ N-1 

■ 1-1  [-W i^F J "■  4pW^uqs 

4^Woq^[— 


M 9 

+ 4pW'  aqs  + 4iJ  pv 


8M‘‘a 


Where 


p - a^+cr^ 

q - (/  a-2p (a^+3aa^) 

t - (/  ^-Au(/  (a^+a^)  + 4p^(a^+6a^a^+3a'*) 

s - i/  - 2p(a^+a^) 

^ - (/  (a^+a^)  - 2p(a^  + 65^a^+3cr^) 
u - ^a  - A^f/  (a^+3ao-^)  + 4p^  (a^+lOa^a^  + 1 5ao''*) 
V - {/  ^(a^+cr^)  - 4m(/  ( a^+6a^a^+3CT^) 


+ 4|i^(a^+15a^CT^+45a^CT^+15a®) 


2-25 


NOTE:  this  result  was  reported  earlier  in  Quarterly  Report  fe3  for  this 
contract.  However,  due  to  an  algebraic  error  the  original  equation, 
equation  }8,  is  incorrect.  Thus  Eq.  2-41  and  2-42  of  this  report  sup- 
plant E^q..  8 and  9 of  Quarterly  Report  #3,  "Exact  Analysis  of  a Special 
Adaptive  Power  Separator". 

This  is  a formidable  expression!  However,  if  |sl<l  and  |r|<l, 

2 2 

then  lim  E{W}  = E{W  } will  converge  to: 

N->oo 


2 2 2 2 2 
E{W^}  = 4p  p + Bp'^a'^t  + 


2 2„2  . 2„ 

I a q 4p  pv 

1-s  1-r 


. Sjj^aut  . 
1-r 


2 2 
8n^aq‘^u 

(1-s) (1-r) 
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Furthermore,  if  we  take  a to  be  zero  and  {/  to  be  1,  then 
VflB(W)  . t _ 


4ya^-12*j^o’^ 


E{W) 


^2  [l-8uo-^+4  8u^g'* 

^ 2 

1-3*1^“^  J 
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This  case  is  that  of  a conventional  LHS  filter,  and  was  analysed 

by  Hidtow  in  [5]  The  approximate  analysis  used  by  Widrow  indicated 

that  the  variance  of  the  weight  should  be  pa  . This  agrees  very  well 

with  the  exact  analysis  if  we  recall  Widrow's  stipulation  that 
2 

pa  <<  1,  which  corresponds  to  slow,  low-noise  adaptation. 

2 

Recall  that  convergence  of  required  that  |s|<l  and  |r|<l. 

The  first  condition  becomes: 


IsKl 


=>  I {/  -2p(a^+a^)  I < 1 


=>  p < 


1±S/ 


2 2 
2 (a^+a^) 


Which  is  the  same  condition  as  for  convergence  of  the  mean  weight 
value.  The  second  condition  becomes: 


|r|<l  =>  I (/  ^-4pC/  p+4p^(a'*  + 6a^a^+3a^)  I < 1 

= > 0 > (^  ^-l-4p(/  p+4p^(a^  + 6a^a^+3a^) 


= > p < 


6a^a^-t^3a^-4(/  ^a^a^-2(/  ^a^ 


2 (a^+6a^o^+3a^^ 
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xf  SNR  - ^ 

Q 

^ ^ (SNR>1)  + v/sNR^  + 6SNR+3-4C/  ^SNR-2C/  ^ 

2 (a^SNR+6a^+3a^) 

2-29 

Again,  this  is  not  a particularly  simple  expression.  Figure  2-13 
is  a plot  of  the  maximum  possible  vs  (/  for  various  SNR's  (holding 
total  input  power  = 1,  maximum  m assuring  convergence  of  mean  and 


maximum 


100,000 


Maximum  y for  convergence  of  variance  vs.  v,  as  a function  of  SNR 
(holding  total  input  power  at  1). 


Figure  2-13 

variance  of  the  weight  vector).  From  this  we  see  that  there  are  two 
limiting  coses:  a)  high  SUR  and  b)  low  SNR.  In  the  high  SNR  case 
eguut  lull  2-44  simplifies  to: 

^ 2 X total-input-power 


which  varies  from 


to 


as  (/  varies 


2 X total'input-power  input-power 
from  0 to  1.  In  the  low  SNR  case  equation  2-44  simplifies  to: 


< 


{/  * vC 


VL 


6 X total-input-power 
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which  varies  from  ■? rrr— t~-^— — = to  — i as  1/ 

6 X total-input-power  3 x total-input-power 

varies  from  0 to  1.  The  most  stringent  requirement  on  p occurs  when 

= 0 (although  in  actual  practice  {/  is  rarely  less  than  0.99)  and 

SNR  is  low.  For  this  case  ^ < -? — . — » n , 

ox  total-input-power  input-power 

If  AJ  is  selected  by  this  criterion,  the  variance  will  always  converge 
and  remain  finite.  Note  that  this  condition  is  more  stringent  than 
the  condition  for  guaranteed  convergence  of  the  mean  which  required 


that : 

^ ^ total- input-power 

in  the  worst  case.  Also,  note  that  the  conditions  for  convergence  in 

the  mean  presented  in  [9,  51  for  an  LM3  filter  (aK-' ) where 

{/  - 1 not  sufficient  to  guarantee  convergence  of  the  variance  in 

low  SNR  regions.  Of  course,  in  normal  practice  a>  is  very  much  smaller 
than  the  bound  so  this  problem  does  not  arise.  However,  if  a p is 
selected  so  that  the  filter  converges  in  the  mean  but  not  in  variance, 
then  we  would  expect  the  weight  to  oscillate  randomly  about  the  mean 
value  with  ever  larger  oscillations.  This  analysis  of  a single-weight 
filter  corroborates  Senne’s  earlier  experimental  work  with  multi- 
weight filters:  that  to  guarantee  convergence  of  the  weight  noise 
variance  requires  p to  be  several  times  smaller  than  the  value  needed 
to  assure  convergence  of  the  mean  weight  value. 


2-F.  Conclusions  of  Part  2_ 

We  have  studied  the  second  order  effects  of  the  Leaky  LMS  (LLMS) 
algorithm.  The  LLMS  algorithm  causes  the  weights  to  vary  about  the 
mean  or  expected  solution.  This  will  modulate  the  output  of  the 
filter,  causing  added  undesirable  noise  components  in  the  filter's 
output.  For  sinusoidal  inputs  with  frequencies  between  10%  and  90%  of 
Nyquist  frequency  we  found  that  the  distortion  power  was  less  than 
0.2%  of  the  desirable  output  power.  For  very  low  frequency  inputs  the 
distortion  power  increased,  but  even  at  1%  of  Nyquist  the  distortion 
power  was  still  less  than  5%.  Furthermore,  most  (98%)  of  the  distor- 
tion was  in  the  third  harmonic. 

For  white  noise  inputs  to  a LLMS  based  Adaptive  Power  Separator 
(APS)  we  have  derived  an  equation  for  the  variance  of  the  noise  in  the 
weight  vector.  This  equation  (Eq.  2-29)  agrees  with  previous  analysis 
(5,  9,  11)  of  weight  vector  noise  in  LiMS  filters,  a special  case  of 
LLMS  in  which  (/=  1.  This  analysis  also  confirms  an  ealier  conjecture 

[I]  that  the  LLMS  algorithm  would  have  less  weight  noise  than  an 
equivalent  injected  noise  scheme. 

Finally,  an  exact  analysis  of  a special  case  (single-weight)  of 
the  LLMS  driven  APS  was  performed.  This  analysis  confirms  Senne's 

(II)  observation  that  LMS  does  not  converge  to  the  Wiener  solution  if 

the  input  is  correlated.  However,  the  bias  from  the  V«iener  solution 
can  be  made  arbitrarily  small  by  decreasing  Also,  we  found  that 

LLMS  (and  LMS)  filters  may  not  stabalize  in  a mean-square  sense  even 
though  they  converge  in  the  mean.  A new  criterion  for  p is  presented 
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which  guarantees  mean-square  stability. 


I 

I 
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